feat(Prover CLI): `status batch --verbose` #1899

ColoCarletti · 2024-05-09T13:51:50Z

This pull request introduces a new flag, verbose, to the status batch command. Retrieves detailed information about the prover jobs for each aggregation round, and circuit for a specific batch number.

To run the command:

zk f cargo run -- status batch -n [1..] --verbose

This command accepts any number of L1 batch numbers.

Example output:

$ cargo run --release -- status batch -n 1 --verbose

== Batch 1 Status ==

-- Aggregation Round 0 --
> Basic Witness Generator: Successful ✅
v Prover Jobs: In Progress ⌛️
   > VM: Successful ✅
   > DecommitmentsFilter: Successful ✅
   > Decommiter: Successful ✅
   > LogDemultiplexer: Successful ✅
   > KeccakPrecompile: In Progress ⌛️
     - Total jobs: 60
     - Successful: 4
     - In Progress: 1
     - Queued: 55
     - Failed: 0
   > RamValidation: Successful ✅
   > StorageFilter: Queued 📥
   > StorageApplicator: Successful ✅
   > EventsRevertsFilter: Queued 📥
   > L1MessagesRevertsFilter: Queued 📥
   > L1MessagesHasher: Queued 📥
   > EIP4844Repack: Queued 📥

-- Aggregation Round 1 --
v Leaf Witness Generator: In Progress ⌛️
   > VM: Successful ✅
   > DecommitmentsFilter: Successful ✅
   > Decommiter: Successful ✅
   > LogDemultiplexer: Successful ✅
   > KeccakPrecompile: Waiting for Proof ⏱️
   > RamValidation: Successful ✅
   > StorageFilter: Waiting for Proof ⏱️
   > StorageApplicator: Successful ✅
   > EventsRevertsFilter: Waiting for Proof ⏱️
   > L1MessagesRevertsFilter: Waiting for Proof ⏱️
   > L1MessagesHasher: Waiting for Proof ⏱️
   > EIP4844Repack: Waiting for Proof ⏱️
> Prover Jobs: Successful ✅

-- Aggregation Round 2 --
v Node Witness Generator: In Progress ⌛️
   > VM: Successful ✅
   > DecommitmentsFilter: Successful ✅
   > Decommiter: Successful ✅
   > LogDemultiplexer: Successful ✅
   > KeccakPrecompile: Waiting for Proof ⏱️
   > RamValidation: Successful ✅
   > StorageFilter: Waiting for Proof ⏱️
   > StorageApplicator: Successful ✅
   > EventsRevertsFilter: Waiting for Proof ⏱️
   > L1MessagesRevertsFilter: Waiting for Proof ⏱️
   > L1MessagesHasher: Waiting for Proof ⏱️
   > EIP4844Repack: Waiting for Proof ⏱️
> Prover Jobs: Successful ✅

-- Aggregation Round 3 --
 > Recursion Tip: Waiting for Proof ⏱️

-- Aggregation Round 4 --
 > Scheduler: Waiting for Proof ⏱️

-- Compression --
 > Compressor: Jobs not found 🚫

Checklist

PR title corresponds to the body of PR (we generate changelog entries from PRs).
Tests for the changes have been added / updated.
Documentation comments have been added / updated.
Code has been formatted via zk fmt and zk lint.
Spellcheck has been run via zk spellcheck.

…sync-era into prover_cli_status_command

…us-cmd

prover/prover_cli/src/commands/status/batch.rs

Artemka374

LGTM overall, but agree with comments above

Oppen · 2024-05-14T19:41:08Z

@Artemka374 there's been an issue with the merge queue. This job failed: https://github.com/matter-labs/zksync-era/actions/runs/9082768899/job/24959975241

$ yarn workspace zk build
$ tsc
Done in 2.55s.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  3 4096M    3  148M    0     0   150M      0  0:00:27 --:--:--  0:00:27  150M
  7 4096M    7  312M    0     0   156M      0  0:00:26  0:00:01  0:00:25  156M
 11 4096M   11  476M    0     0   159M      0  0:00:25  0:00:02  0:00:23  159M
 14 4096M   14  612M    0     0   153M      0  0:00:26  0:00:03  0:00:23  153M
 16 4096M   16  692M    0     0   153M      0  0:00:26  0:00:04  0:00:22  153M
curl: (56) Recv failure: Connection reset by peer

ilitteri · 2024-05-14T20:28:55Z

@Artemka374 there's been an issue with the merge queue. This job failed: https://github.com/matter-labs/zksync-era/actions/runs/9082768899/job/24959975241

$ yarn workspace zk build
$ tsc
Done in 2.55s.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  3 4096M    3  148M    0     0   150M      0  0:00:27 --:--:--  0:00:27  150M
  7 4096M    7  312M    0     0   156M      0  0:00:26  0:00:01  0:00:25  156M
 11 4096M   11  476M    0     0   159M      0  0:00:25  0:00:02  0:00:23  159M
 14 4096M   14  612M    0     0   153M      0  0:00:26  0:00:03  0:00:23  153M
 16 4096M   16  692M    0     0   153M      0  0:00:26  0:00:04  0:00:22  153M
curl: (56) Recv failure: Connection reset by peer

Yep, we'll probably need to re-queue until it passes

🤖 I have created a release *beep* *boop* --- ## [24.3.0](core-v24.2.0...core-v24.3.0) (2024-05-16) ### Features * Added support for making EN a (non-leader) consensus validator (BFT-426) ([#1905](#1905)) ([9973629](9973629)) * **configs:** Extract secrets to an additional config ([#1956](#1956)) ([bab4d65](bab4d65)) * **en:** Fetch L1 batch root hashes from main node ([#1923](#1923)) ([72a3571](72a3571)) * **eth-client:** Generalize RPC client ([#1898](#1898)) ([a4e099f](a4e099f)) * **Prover CLI:** `requeue` cmd ([#1719](#1719)) ([f722df7](f722df7)) * **Prover CLI:** `status batch --verbose` ([#1899](#1899)) ([cf80184](cf80184)) * **pruning:** Vacuum freeze started daily ([#1929](#1929)) ([5c85e9f](5c85e9f)) * Remove metrics crate ([#1902](#1902)) ([5f7bda7](5f7bda7)) * **state-keeper:** Parallel l2 block sealing ([#1801](#1801)) ([9b06dd8](9b06dd8)) * tee_verifier_input_producer ([#1860](#1860)) ([fea7f16](fea7f16)) * **vm-runner:** implement output handler for VM runner ([#1856](#1856)) ([1e4aeb5](1e4aeb5)) ### Bug Fixes * **basic_types:** bincode deserialization for `web3::Bytes` ([#1928](#1928)) ([406ec8c](406ec8c)) * **config:** Fix data-handler-config ([#1919](#1919)) ([b6bb041](b6bb041)) * **en:** Delete old txs by (init_addr, nonce) ([#1942](#1942)) ([fa5f4a7](fa5f4a7)) * **en:** Fix reorg detector logic for dealing with last L1 batch ([#1906](#1906)) ([3af5f5b](3af5f5b)) * parentHash in websocket blocks subscription is shown as 0x0 ([#1946](#1946)) ([fc2efad](fc2efad)) * **Prover CLI:** `status batch` bugs ([#1865](#1865)) ([09682f2](09682f2)) * **utils:** bincode ser-/deserialization for `BytesToHexSerde` ([#1947](#1947)) ([a75b917](a75b917)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please). --------- Co-authored-by: zksync-era-bot <zksync-era-bot@users.noreply.github.com>

🤖 I have created a release *beep* *boop* --- ## [14.2.0](prover-v14.1.1...prover-v14.2.0) (2024-05-17) ### Features * Added support for making EN a (non-leader) consensus validator (BFT-426) ([#1905](#1905)) ([9973629](9973629)) * **configs:** Extract secrets to an additional config ([#1956](#1956)) ([bab4d65](bab4d65)) * **eth-client:** Generalize RPC client ([#1898](#1898)) ([a4e099f](a4e099f)) * **Prover CLI:** `delete` cmd ([#1802](#1802)) ([6e4a92e](6e4a92e)) * **Prover CLI:** `requeue` cmd ([#1719](#1719)) ([f722df7](f722df7)) * **Prover CLI:** `status batch --verbose` ([#1899](#1899)) ([cf80184](cf80184)) * **state-keeper:** Parallel l2 block sealing ([#1801](#1801)) ([9b06dd8](9b06dd8)) * tee_verifier_input_producer ([#1860](#1860)) ([fea7f16](fea7f16)) ### Bug Fixes * **Prover CLI:** `status batch` bugs ([#1865](#1865)) ([09682f2](09682f2)) * **prover:** Bump Cargo.lock and update VKs ([#1959](#1959)) ([367baad](367baad)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).

ColoCarletti and others added 30 commits April 8, 2024 13:42

fmt

17e564c

wip

245b0a4

add cargo.toml cargo.lock

8e84243

go back to anihow

17517b1

fmt

4ab7ce8

rm tool workspace

4655201

fmt

c32d1aa

zk fmt

8e49e04

fix typo

80e13da

move query to prover_dal

0f2ebd8

remove --all flag

69d2104

change command name

c9e6e5e

merge main

83fab40

fmt

cdbb467

add sqlx query json

d1f3994

Merge branch 'main' into prover_cli_status_command

4ee3ff2

update README

fff3910

zk fmt

ef906b9

Merge branch 'prover_cli_status_command' of github.com:matter-labs/zk…

3758547

…sync-era into prover_cli_status_command

remove eol

b3051b2

Move jobs cmd to status cmd module

ee9d35b

Refactor status cmd

82faf32

Update Cargo.lock

aa44864

zk fmt

3fe32b6

Merge pull request #1705 from matter-labs/il-refactor-prover-cli-stat…

d43dd15

…us-cmd

Merge branch 'main' into prover_cli_status_command

70b0348

Merge branch 'main' into prover_cli_status_command

585059b

Refactor

9977e95

Merge branch 'main' into prover_cli_status_command

ee88cfe

Merge branch 'main' into prover_cli_status_command

075e6dc

Merge branch 'main' into prover_cli_status_verbose

275dc9b

Oppen reviewed May 13, 2024

View reviewed changes

prover/prover_cli/src/commands/status/batch.rs Show resolved Hide resolved

Oppen reviewed May 13, 2024

View reviewed changes

prover/prover_cli/src/commands/status/batch.rs Outdated Show resolved Hide resolved

Oppen reviewed May 13, 2024

View reviewed changes

prover/prover_cli/src/commands/status/batch.rs Outdated Show resolved Hide resolved

Merge branch 'main' into prover_cli_status_verbose

c36713a

Artemka374 previously approved these changes May 14, 2024

View reviewed changes

refactor

bdba814

ColoCarletti dismissed Artemka374’s stale review via bdba814 May 14, 2024 13:31

ColoCarletti and others added 6 commits May 14, 2024 10:36

Merge branch 'main' into prover_cli_status_verbose

1572f97

fix small print error

80c4e74

zk fmt

67beeb9

fix imports

a1bd89e

fix typo

4194e29

Merge branch 'main' into prover_cli_status_verbose

f5b34a3

ColoCarletti requested review from Artemka374 and Oppen May 14, 2024 14:24

Artemka374 approved these changes May 14, 2024

View reviewed changes

Artemka374 added this pull request to the merge queue May 14, 2024

github-merge-queue bot removed this pull request from the merge queue due to failed status checks May 14, 2024

Merge branch 'main' into prover_cli_status_verbose

6d83e78

Artemka374 added this pull request to the merge queue May 15, 2024

Merged via the queue into main with commit cf80184 May 15, 2024
50 checks passed

Artemka374 deleted the prover_cli_status_verbose branch May 15, 2024 10:18

This was referenced May 15, 2024

chore(main): release core 24.3.0 #1924

Merged

chore(main): release prover 14.2.0 #1926

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(Prover CLI): `status batch --verbose` #1899

feat(Prover CLI): `status batch --verbose` #1899

ColoCarletti commented May 9, 2024 •

edited

Loading

Artemka374 left a comment •

edited

Loading

Oppen commented May 14, 2024

ilitteri commented May 14, 2024

feat(Prover CLI): status batch --verbose #1899

feat(Prover CLI): status batch --verbose #1899

Conversation

ColoCarletti commented May 9, 2024 • edited Loading

Checklist

Artemka374 left a comment • edited Loading

Choose a reason for hiding this comment

Oppen commented May 14, 2024

ilitteri commented May 14, 2024

feat(Prover CLI): `status batch --verbose` #1899

feat(Prover CLI): `status batch --verbose` #1899

ColoCarletti commented May 9, 2024 •

edited

Loading

Artemka374 left a comment •

edited

Loading